TAI Knowledge Engineering: A Frameworks Perspective

Charles F Vardeman II

2023-08-16

How it started…

How its going…

Shirui Pan, Linhao Luo, Yufei Wang, Chen Chen, Jiapu Wang, and Xindong Wu. “Unifying Large Language Models and Knowledge Graphs: A Roadmap.” arXiv, June 14, 2023. http://arxiv.org/abs/2306.08302.

Unifying Large Language Models and Knowledge Graphs: A Roadmap

RManLuo/Awesome-LLM-KG: Awesome papers about unifying LLMs and KGs (https://github.com/RManLuo/Awesome-LLM-KG)

“The Semantic Web (2001)…”

A vision of “Ontologies”, “Linked Data”, and “Software Agents”…

Tim Berners-Lee, James Hendler, and Ora Lassila. “The Semantic Web.” Scientific American 284, no. 5 (2001): 34–43. https://lassila.org/publications/2001/SciAm.html

Ontology based ETL

(Step 1) CVS Data in Pandas Data Frame

(Step 2) Extract Columns from Pandas Data Frame to create mapping

JSONL LD for Linked Datsa

JSON-LD 1.1: A JSON-based Serialization for Linked Data

(Step 3) Generate JSON-LD from JSON

(Step-4) Generate KG from JSON-LD

(Step-5) Validate Against SHACL Shapes

Automated Vocabulary Extraction

Experiments in extracting tables from navy 3-M manual for OPNAV 4790/2K data structure resources

LLM assisted ODPs using Pattern Templates

Maintenance Operations Ontology (MOO)

Maintenance Operations Ontology

Leveraging Standards

Schema.org - schemas and supporting software

Ontology Engineering in a Age of LLMs

Applying Software Engineering to Ontologies

Eva Blomqvist, Karl Hammar, and Valentina Presutti. “Engineering Ontologies with Patterns – The EXtreme Design Methodology.” In Ontology Engineering with Ontology Design Patterns, 23–50. IOS Press, 2016. https://doi.org/10.3233/978-1-61499-676-7-23.

Applying Software Engineering to Ontologies

Cogan Shimizu, Karl Hammar, and Pascal Hitzler. “Modular Ontology Modeling.” Edited by Sabrina Kirrane, Axel-Cyrille Ngonga Ngomo, Sabrina Kirrane, and Axel-Cyrille Ngonga Ngomo. Semantic Web 14, no. 3 (April 5, 2023): 459–89. https://doi.org/10.3233/SW-222886.

FAIR Ontologies and Vocabularies

Garijo, Daniel, and María Poveda-Villalón. “Best Practices for Implementing FAIR Vocabularies and Ontologies on the Web.” arXiv, March 29, 2020. http://arxiv.org/abs/2003.13084.

Visual Ontology Development

Garijo, Daniel, and María Poveda-Villalón. “Best Practices for Implementing FAIR Vocabularies and Ontologies on the Web.” arXiv, March 29, 2020. http://arxiv.org/abs/2003.13084.

Self Documenting Ontologies

Garijo, Daniel. “WIDOCO: A Wizard for Documenting Ontologies.” In International Semantic Web Conference, 94–102. Springer, Cham, 2017. https://doi.org/10.1007/978-3-319-68204-4_9.http://dgarijo.com/papers/widoco-iswc2017.pdf Garijo, Daniel. “WIDOCO: A Wizard for Documenting Ontologies.” Java, 2017. https://doi.org/10.1007/978-3-319-68204-4_9.https://github.com/dgarijo/Widoco

Resources to Learn More…

Software…

Python

Learn More: Think Python 2e: https://greenteapress.com/wp/think-python-2e/

Python for Data Analysis

Practical Deep Learning: https://wesmckinney.com/book/

AI and Machine Learning

Practical Deep Learning: https://course.fast.ai/ FastAI GitHub: https://github.com/fastai

Setting up Environment

Visual Studio Code

Visual Studio Code - Code Editing. Redefined: https://code.visualstudio.com/

Visual Studio Code Plugins

Visual Studio Code - Code Editing. Redefined: https://code.visualstudio.com/

GitHub

Homebrew/WSL (Mac and Windows)

Markdown

Markdown Guide

KGC Master Class on JSON-LD Pipeline

Learn More: Converting Legacy Enterprise Data into Knowledge Graphs with AI and JSON LD

Ontologies and data integration

KGC 2023 Talk: In Defense of Inconsistency, On Managing Truth in a Knowledge Graph - YouTube

Unifying Large Language Models and Knowledge Graphs: A Roadmap

Learn More: [RManLuo/Awesome-LLM-KG: Awesome papers about unifying LLMs and KGs (github.com)

The Knowledge Graph Book

Hogan, Aidan, Claudio Gutierrez, Michael Cochez, Gerard De Melo, Sabrina Kirrane, Axel Polleres, Roberto Navigli, et al. Knowledge Graphs. Synthesis Lectures on Data, Semantics, and Knowledge. Cham: Springer International Publishing, 2022. https://doi.org/10.1007/978-3-031-01918-0.

ChatGPT Experiment

Learn More: ChatGPT Code Interpreter